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Abstract. In the standard Random Surfer Model, the teleportation ma¬ 
trix is necessary to ensure that the final PageRank vector is well-defined. 
The introduction of this matrix, however, results in serious problems and 
imposes fundamental limitations to the quality of the ranking vectors. In 
this work, building on the recently proposed NCDawareRank framework, 
we exploit the decomposition of the underlying space into blocks, and 
we derive easy to check necessary and sufficient conditions for random 
surfing without teleportation. 
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1 Introduction Motivation 

The astonishing amount of information available on the Web and the highly 
variable quality of its content generate the need for an absolute measure of 
importance for Web pages, that can be used to improve the performance of Web 
search. Link Analysis algorithms such as the celebrated PageRank , try to answer 
this need by using the link structure of the Web to assign authoritative weights 
to the pages m- 

PageRank’s approach is based on the assumption that links convey human 
endorsement. For example, the existence of a link from page 3 to page 7 in 
Fig. [lja) is seen as a testimonial of the importance of page 7. Furthermore, the 
amount of importance conferred to page 7 is proportional to the importance 
of page 3 and inversely proportional to the number of pages 3 links to. In their 
original paper, Page et al. 03 imagined of a random surfer who, with probability 
a follows the links of a Web page, and with probability 1 — a jumps to a different 
page uniformly at random. Then, following this metaphor, the overall importance 
of a page was defined to be equal to the fraction of time this random surfer spends 
on it, in the long run. 

Formulating PageRank’s basic idea with a mathematical model, involves 
viewing the Web as a directed graph with Web pages as vertices and hyper¬ 
links as edges. Given this graph, we can construct a row-normalized hyperlink 
matrix H, whose element [H] ut , is one over the outdegree of u if there is a link 
from u to v, or zero otherwise. The matter of dangling nodes is fixed with some 
sort of stocliasticity adjustment, thereby transforming the initial matrix H, to 
a stochastic matrix. 
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(b) NCDawareRank 


Fig. 1: In the left figure we see a tiny graph as viewed by PageRank and in the 
right, the same graph as viewed by NCDawareRank. Same colored nodes belong 
to the same block and are considered related according to a given criterion. 


A second adjustment is needed to certify that the final matrix is irreducible 
and aperiodic, so that it possesses a unique positive stationary probability dis¬ 
tribution. That is ensured by the introduction of the damping factor a and a 
teleportation matrix E, usually defined by E = -ee T . The resulting matrix is 
given by: 

G = aH+(l-a)E (1) 

PageRank vector is the unique stationary distribution of the Markov chain cor¬ 
responding to matrix G. 

The choice of the damping factor has received much attention since it de¬ 
termines the fraction of the importance of a node that is propagated through 
the edges rather than scattered throughout the graph via the teleportation ma¬ 
trix. Obviously, picking a very small damping factor ignores the link structure 
of the graph and results in uninformative ranking vectors. On the other hand, 
setting the damping factor very close to one, causes a number of serious prob¬ 
lems. From a computational perspective, as a —> 1, the number of iterations 
till convergence to the PageRank vector grows prohibitively, and also makes the 
computation of the rankings numerically ill-conditioned |ll!12j . Moreover, from 
a qualitative point of view, various studies indicate that damping factors close 
to 1 result into counterintuitive ranking vectors where all the PageRank gets 
concentrated mostly in irrelevant nodes, while the Web’s core component is as¬ 
signed null rank mm- Finally, the very existence of the damping factor and 
the related teleportation matrix “opens the door” to direct manipulation of the 
ranking score through link spamming |6l8j . 

In the literature there have been proposed several ranking methods that 
try to address these issues. Boldi jS] proposed an algorithm that eliminates 
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PageRank’s dependency on the arbitrarily chosen parameter a by integrating 
the ranking vector over the entire range of possible damping factors. Baeza-Yates 
et al. [2] introduced a family of link-based ranking algorithms parametrised by 
the selection of a damping function that describes how rapidly the importance of 
paths decays as the path length increases. Constantine and Gleich [B] proposed 
a ranking method that considers the influence of a population of random surfers, 
each choosing its own damping factor from a probability distribution. 

All the above methods attack the problem from the damping factor point 
of view, while taking the teleportation matrix as granted. Nikolakopoulos and 
Garofalakis m on the other hand, focus on the teleportation model itself. 
Building on the intuition behind Nearly Decomposable Systems 1712012 II . the 
authors proposed NCDawareRank; a novel ranking framework that generalizes 
and refines PageRank by enriching the teleportation model in a computation¬ 
ally efficient way. NCDawareRank decomposes the underlying space into NCD 
blocks, and uses these blocks to define indirect relations between the nodes in 
the graph (Fig.Qb)) which lead to the introduction of a new inter-level proxim¬ 
ity component. A comprehensive set of experiments done by the authors using 
real snapshots of the Web Graph showed that the introduction of this decom¬ 
position alleviates the negative effects of uniform teleportation and produces 
ranking vectors that display low sensitivity to sparsity and, at the same time, 
exhibit resistance to direct manipulation through link spamming (see the discus¬ 
sion in Sections 4.2 and 4.3 in m for further details). However, albeit reducing 
some of its negative effects, NCDawareRank model also includes the standard 
teleportation matrix as a purely mathematical necessity. But, is it? 

The main questions we try to address in this work are the following: Is it 
possible to discard the uniform teleportation altogether? And if so, under which 
conditions? Thankfully, the answer is yes. In particular, we show that, the defi¬ 
nition of the NCD blocks, can be enough to ensure the production of well-defined 
ranking vectors without resorting to uniform teleportation. The criterion for this 
to be true is expressed solely in term of properties of the proposed decomposi¬ 
tion, which makes it very easy to check and at the same time gives insight that 
can lead to better decompositions for the particular ranking problems under 
consideration. 

The rest of the paper is organized as follows: After discussing NCDawareRank 
model (Section [2| we derive sufficient and necessary conditions under which 
the inter-level proximity matrix enables us to discard the teleportation matrix 
completely (Section |3.2| ). In Section [4j we generalize NCDawareRank model, 
in order to allow the definition of overlapping blocks without compromising its 
theoretical and computational properties. Finally, in Section [5] we discuss future 
direction and conclude this work. 


2 NCDawareRank Model 

Before we proceed to our main result, we present here the basic definitions behind 
the NCDawareRank model. Our presentation follows the one given in m ■ 
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2.1 Notation 

All vectors are represented by bold lower case letters and they are column vectors 
(e.g., 7r). All matrices are represented by bold upper case letters (e.g., P). The 
z th row and j th column of matrix P are denoted pj and p^, respectively. The 
ij th element of matrix P is denoted [P]«- We use Diag(u;) to denote the matrix 
having vector u> on its diagonal, and zeros elsewhere. We use calligraphic letters 
to denote sets (e.g., U , V). [1, n] is used to denote the set of integers {1,2,..., n}. 
Finally, symbol = is used in definition statements. 

2.2 Definitions 

Let U be a set of nodes (e.g. the universe of Web pages) and denote n = \U\. 
Consider a node uinU. We denote Q u to be the set of nodes that can be visited 
in a single step from u. Clearly, d u = \Q U | is the out-degree of u, i.e. the number 
of outgoing edges of u. 

We consider a partition of the underlying space U that defines a decompo¬ 
sition: 

( 2 ) 

such that, ^ 0, for all k in [1, K\. 

Each set Vj is referred to as an NCD Block, and its elements are considered 
related according to a given criterion, chosen for the particular ranking problem 
(e.g. the partition of the set of Web Pages into websites). 

We define M u to be the set of proximal nodes of u, i.e the union of the NCD 
blocks that contain u and the nodes it links to. Formally, the set M u is defined 
by: 


M u 4 |J V {w) (3) 

w£(uL)Q u ) 

where T^( U ) is used to denote the unique block that includes node u. Finally, N u 
denotes the number of different blocks in Mu- 


Hyperlink Matrix. The hyperlink matrix H, as in the standard PageRank 
Model, is a row normalized version of the adjacency matrix induced by the 
graph, and its uv th element is defined as follows: 


[HI 


^ if v e Q u 
0 otherwise 


(4) 


Matrix H is assumed to be a row-stoclrastic matrix. The matter of dangling 
nodes (i.e. nodes with no outgoing edges) is considered fixed through some 
sort of stochasticity adjustment. 

Inter-Level Proximity Matrix. The Inter-Level Proximity matrix M is cre¬ 
ated to depict the interlevel connections between the nodes in the graph. In 
particular, each row of matrix M denotes a probability vector mj , that dis¬ 
tributes evenly its mass between the N u blocks of M u , and then, uniformly 
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to the included nodes of each block. Formally, the uv th element of matrix 
M, that relates the node u with node v, is defined as 


[M] ul , 4 


1 

Nu\T> M | 

0 


if v £ M u 
otherwise 


(5) 


From the definition of the NCD blocks and the proximal sets, it is clear that 
whenever the number of blocks is smaller than the number of nodes in the 
graph, i.e. K < n, matrix M is necessarily low-rank; in fact, a closer look 
at the definitions ([3| and ([5| above, suggests that matrix M admits a very 
useful factorization, which was shown in m to ensure the tractability of the 
resulting model. In particular, matrix M can be expressed as a product of 2 
extremely sparse matrices, R and A, defined below. 

Matrix A £ R Kxn is defined as follows: 


A = 


e jx>i | 0 0 

0 e {v 2 \ 0 

0 0 


0 0 0 


0 

0 

0 

0 

P T 

\V K \\ 


( 6 ) 


where eL, , denotes a row vector in ]Rl x>fc I whose elements are all 1. Now, 
using the diagonal matrix A: 


A = Diag ( [\T>i | |2? 2 | ••• \V K \]) (7) 

and a row normalized matrix T £ R nxK , whose rows correspond to nodes 
and columns to blocks and its elements are given by 


[r]y ^ 



if Dj £ M Ui 
otherwise 


( 8 ) 


we can define the matrix R as follows: 


R = TA 1 (9) 

Using ([6]) and it is straight forward to verify that: 

M = RA (10) 

R£R nxK A e K A ' xn 


As pointed out by the authors 115j . this factorization can lead to significant 
advantages in realistic scenarios, in terms of both storage and computability 
(see [13], Section 3.2.1). 

Teleportation Matrix. Finally, NCDawareRank model also includes a tele¬ 
portation matrix E, 

E = ev T (11) 
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where, v > 0 such that v T e = 1. The introduction of this matrix, can be seen 
as a remedy to ensure that the underlying Markov chain, corresponding to 
the final matrix, is irreducible and aperiodic and thus has a unique positive 
stationary probability distribution 1131 . 


The resulting matrix which we denote P is expressed by: 

P = ??H + fiM + (1 - r] - n)E (12) 

Parameter rj controls the fraction of importance delivered to the outgoing edges 
and parameter /i controls the fraction of importance that will be propagated to 
the proximal nodes. In order to ensure the irreducibility and aperiodicity of the 
final stochastic matrix in the general case, tj + n must be less than 1. This leaves 
\ — rj — fj, oi importance scattered throughout the graph through matrix E. 


3 Necessary and Sufficient Conditions for Random 
Surfing Without Teleportation 


Although in the general case the teleportation matrix is required to ensure the 
final stochastic matrix produces a well-defined ranking vector, in this Section we 
show that NCDawareRank model carries the possibility of discarding matrix E 
altogether. Before we proceed to the proof of our main result (Section 3.2) we 
present here the necessary preliminary definitions and theorems. 


3.1 Preliminaries 

Definition 1 (Irreducibility). An n x n non-negative matrix P is called ir¬ 
reducible if for every pair of indices i,j £ [l,n], there exists a positive integer 
m = m(i,j ) such that [P m ]ij > 0. The class of all non-negative irreducible 
matrices is denoted 3. 

Definition 2 (Period). The period of an index i £ [l,n] is defined to be the 
greatest common divisor of all positive integers m such that [P m ]u > 0. 

Proposition 1 (Periodicity as a Matrix Property). For an irreducible ma¬ 
trix, the period of every index is the same and is referred to as the period of the 
matrix. 

Definition 3 (Primitivity). An irreducible matrix with period d = 1, is called 
primitive. The important subclass of all primitive matrices will be denoted 

Finally, we give here, without proof, the following fundamental result of the 
theory of non-negative matricctj^j 

3 For thorough treatment of the theory as well as proofs to several formulations of the 
Perron-Frobenius theorem the interested reader can see m 




Random Surfing Without Teleportation 


7 


Theorem 1 (Perron-Frobenius Theorem for Primitive Matrices f9ll8l D 

Suppose T is an n x n non-negative primitive matrix. Then, there exists an 
eigenvalue r such that: 

(a) r is real and positive, 

(b) with r can be associated strictly positive left and right eigenvectors, 

(c) r > | A | for any eigenvalue A ^ r 

(d) the eigenvectors associated with r are unique to constant multiples, 

(e) if 0 < B < T and /3 is an eigenvalue of B. then \j3\ < r. Moreover, 

\P\ = r =► B = T 

(f) r is a simple root of the characteristic equation of T. 

3.2 NCDawareRank Primitivity Criterion 

Mathematically, in the standard PageRank model the introduction of the tele¬ 
portation matrix can be seen as a primitivity adjustment of the final stochastic 
matrix. Indeed, the hyperlink matrix is typically reducible nan], so if the tele¬ 
portation matrix had not existed the PageRank vector would not be well-defined. 

In the general case, the same holds for NCDawareRank, as well. However, 
for suitable decompositions of the underlying graph, matrix M opens the door 
for achieving primitivity without resorting to the uninformative teleportation 
matrix. Here, we show that this “suitability” of the decompositions can, in fact, 
be reflected on the properties of a low dimensional Indicator Matrix defined 
below: 

Definition 4 (Indicator Matrix). For every decomposition At, we define an 
Indicator Matrix'W £ M. KxK designed to capture the inter-block relations of the 
underlying graph. Concretely, matrix W is defined as follows: 

W = AR, 

where A, R are the factors of the inter-level proximity matrix M. 

Clearly, whenever [W]/j is positive, there exists a node u £ Vj such that 
Dj £ A4 U . Intuitively, one can see that a positive element in matrix W implies 
the existence of possible inter-level “random surfing paths” between the nodes 
belonging to the corresponding blocks. Thus, if the indicator matrix W is irre¬ 
ducible, these paths exist between every pair of nodes in the graph, which makes 
the stochastic matrix M also irreducible. 

In fact, in the following theorem we show that the irreducibility of matrix 
W is enough to certify the primitivity of the final NCDawareRank matrix, P. 
Then, just choosing positive numbers rj, fi that sum to one, leads to a well-defined 
ranking vector produced by an NCDawareRank model without a teleportation 
component. 
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Theorem 2 (Primitivity Criterion). The NCDawareRank matrix P = r;H + 
(iM, with r) and fj, positive real numbers such that 77 + /x = 1 , is primitive if and 
only if the indicator matrix W is irreducible. Concretely, P G ip W G 3. 

Proof. We will first prove that 

W G 3 => P G «p (13) 

First notice that whenever matrix W is irreducible then it is also primitive. 
In particular, it is known that when a non-negative irreducible matrix has at 
least one positive diagonal element, then it is also primitive. In case of matrix 
W, notice that by the definition of the proximal sets and matrices A, R, we 
get that [W]jj > 0 for every i in [1 ,K\. Thus, the irreducibility of the indicator 
matrix ensures its primitivity also. Formally, we have 

W G 3 =^> W G fp (14) 

Now if the indicator matrix W is primitive the same is true for the inter-level 
proximity matrix M. We prove this in the following lemma. 

Lemma 1. The primitivity of the indicator matrix W implies the primitivity of 
the inter-level proximity matrix M, defined over the same decomposition, i.e 

Wg*) 3 => MGf (15) 


Proof. It suffices to show that there exists a number m, such that for every pair 
of indices i,j, > 0 holds. Or equivalently there exists a positive integer 

m such that M m is a positive matrix (see [19l). 

This can be seen easily using the factorization of matrix M given above. In 
particular, since W G fp, there exists a positive integer k such that W fc > 0. 
Now, if we choose m = k + 1, we get: 

M m = (RA) fc+1 

= (RA)(RA) ■ • • (RA) 

S, _✓ 

k-\- 1 times 

= R (AR) (AR) • • • (AR) A 

k times 

= RW fc A (16) 

However, matrix W fc is positive and since every row of matrix R and every 
column of matrix A are ■ by definition - non-zero, the final matrix, M m , is also 
positive. Thus, M G 1)3, and the proof is complete. □ 

Now, in order to get the primitivity of the final stochastic matrix P, we 
use the following useful lemma which shows that any convex combination of 
stochastic matrices that contains at least one primitive matrix, is also primitive. 
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Lemma 2. Let A be a primitive stochastic matrix and Bi, B 2 ,..., B n stochas¬ 
tic matrices, then matrix 

C = aA + /3 1 B 1 + • • • + /3 n B n 

where a > 0 and (3i,... ,/3 n > 0 such that a + /3\ + ■ ■ ■ + /3 n = 1 is a primitive 
stochastic matrix. 

Proof. Clearly matrix C is stochastic as a convex combination of stochastic 
matrices (see pi|). For the primitivity part it suffices to show that there exists a 
natural number, m, such that C m > 0. This can be seen very easily. In particular, 
since matrix A £ *$, there exists a number k such that every element in A k is 
positive. 

Consider the matrix C m : 


C m = (aA + /? 1 B 1 + --.+/?„B n r 

= a m A m + (sum of non-negative matrices) (17) 

Now letting m = k, we get that every element of matrix C k is strictly positive, 
which completes the proof. □ 

As we have seen, when W £ 3, matrix M is primitive. Furthermore, M 
and H are by definition stochastic. Thus, Lemma [2] applies and we get that the 
NCDawareRank matrix P, is also primitive. In conclusion, we have shown that: 

(18) 

which proves the reverse direction of the theorem. 

To prove the forward direction (i.e. P £ => W £ 3) it suffices to show 

that whenever matrix W is reducible, matrix P is also reducible (and thus, not 
primitive csd- First observe that when matrix W is reducible the same holds 
for matrix M. 


Lemma 3. The reducibility of the indicator matrix W implies the reducibility 
of the inter-level proximity matrix M. Concretely, 

W 3 => M 3 (19) 


Proof. Assume that matrix W is reducible. Then, there exists a permutation 
matrix II such that IIWn T has the form 


X Z 
0 Y 


( 20 ) 


where X, Y are square matrices [19] . Notice that a similar block upper triangular 
form can be then achieved for matrix M. In particular, the existence of the block 
zero matrix in (20), together with the definition of matrices A,R ensures the 
existence of a set of blocks, that have the property none of their including nodes 
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to have outgoing edges to the rest of the nodes in the grapl^J Thus, organizing 
the rows and columns of matrix M such that these nodes are assigned the last 
indices, results in a matrix M that has a similarly block upper triangular form. 
This makes M reducible too. □ 


Thus, we only need to show that the reducibility of matrix M implies the 
reducibility of matrix P also. This can arise from the fact that by definition 


[M] 0 - = 0 


[Hl„ = 0. 


( 21 ) 


So, the permutation matrix that brings M in the form of (20), has exactly the 
same effect on matrix H. Similarly the final stochastic matrix P has the same 
block upper triangular form as a sum of matrices H and M. This makes matrix 
P reducible and hence non-primitive. 

Therefore, we have shown that W ^ ==> P ^ 3, which is equivalent to 


Pe? 


Wei 


( 22 ) 


Putting everything together, we see that both directions of our theorem have 
been established. Thus we get, 

P e ^ We3 (23) 


and our proof is complete. □ 

Now, when the stochastic matrix P is primitive, from the Perron-Frobenius 
theorem it follows that its largest eigenvalue - which is equal to 1 - is unique and 
it can be associated with strictly positive left and right eigenvectors. Therefore, 
under the conditions of Theorem [2j the ranking vector produced by the NC- 
DawareRank model - which is defined to be the stationary distribution of the 
stochastic matrix P: (a) is uniquely determined as the (normalized) left eigen¬ 
vector of P that corresponds to the eigenvalue 1 and, (b) its support includes 
every node in the underlying graph. The following corollary, summarizes the 
result. 


Corollary 1. When the indicator matrix W is irreducible , the ranking vector 
produced by NCDawareRank with P = 77H+/rM, where 77 , /i positive real numbers 
such that ?7 + /Lt = 1 holds, denotes a well-defined distribution that assigns positive 
ranking to every node in the graph. 


4 Generalizing the NCDawareRank Model 
4.1 The Case of Overlapping Blocks 

In our discussion so far, we assumed that the block decomposition defines a 
partition of the underlying space. However, in many realistic ranking scenarios 

4 notice that if this was not the case, there would be a nonzero element in the block 
below the diagonal necessarily. 
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it would be useful to be able to allow the blocks to overlap. For example, if one 
wants to produce top N lists of movies for a ranking-based recommender system, 
using NCDawareRank, a very intuitive criterion for decomposition would be 
the one depicting the categorization of movies into genres M- Of course, such 
a decomposition naturally results in overlapping blocks, since a movie usually 
belongs to more than one genres. 

Fortunately, the factorization of the inter-level proximity matrix, paves the 
path towards a straight forward generalization, that inherits all the useful math¬ 
ematical properties and computational characteristics of the standard NCDawar¬ 
eRank model. 

In particular, it suffices to modify the definition of decompositions as indexed 
families of non-empty sets 

M±{D 1 ,...,T>k} (24) 


that collectively cover the underlying space, i.e. 

K 

u=\Jv k 

k= 1 


and to change slightly the definitions of the: 


— Proximal Sets: 

M u = |J A 

w £ (wU Q u ), w € 'D k 

— Inter-Level Proximity Matrix: 


[mu = E 

'D k eM u ,v&'D k 


1 

N u \V k \ 


(25) 


(26) 


(27) 


— Factor Matrices A, R: We first define a matrix X, whose ik th element is 1, if 
T>k & AR and zero otherwise, and a matrix Y £ R Axn , whose kj th element 
is 1 if Vj £ T>k and zero otherwise. Then, if R, A denote the row-normalized 
versions of X and Y respectively, matrix M can be expressed as: 

M = RA, Rer xK (28) 


Remark 1. Notice that the Inter-Level Proximity Matrix above is a well-defined 
stochastic matrix, for every possible decomposition. Its stochasticity can arise 
immediately from the row normalization of matrices R, A, together with the fact 
that neither matrix X nor matrix Y have zero rows. Indeed, the existence of a 
zero row in matrix X implies IA ^ (jEi which contradicts the definition of 
Af; similarly the existence of a zero row in matrix Y contradicts the definition 
of the NCD blocks V which are defined to be non-empty. 

Remark 2. Also notice that our primitivity criterion given by Theorem[2j applies 
in the overlapping case too, since our proof made no assumption for mutual ex¬ 
clusiveness for the NCD-blocks. In fact, it is intuitively evident that overlapping 
blocks promote the irreducibility of the indicator matrix W. 
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5 Discussion and Future Work 

In this work, using an approach based on the theory of non-negative matrices, 
we study NCDawareRank’s inter-level proximity model and we derive neces¬ 
sary and sufficient conditions, under which the underlying decomposition alone 
could result in a well-defined ranking vector - eliminating the need for uniform 
teleportation. Our goals here were mainly theoretical. However, our first find¬ 
ings in applying this “no teleportation” approach in realistic problems suggest 
that the conditions for primitivity are not prohibitively restrictive, especially 
if the criterion behind the definition of the decomposition implies overlapping 
blocks mm]. 

A very exciting direction we are currently pursuing involves the spectral 
implications of the absence of the teleportation matrix. In particular, a very 
interesting problem would be to determine bounds of the subdominant eigen¬ 
value of the stochastic matrix P = ?yH + /iM, when the indicator matrix W 
is irreducible. Another important direction would be to proceed to randomized 
definitions of blocks that satisfy the primitivity criterion and to test the effect 
on the quality of the ranking vector. 

In conclusion, we believe that our results, suggest that the NCDawareRank 
model presents a promising approach towards generalizing and enriching the 
standard random surfer model, and also carries the potential of providing an 
intuitive alternative teleportation scheme to the many applications of PageRank 
in hierarchical or otherwise specially structured graphs. 
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